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ABSTRACT The ' variation in conflict ^nd ambiguity ^mong a 

national sample of directors of .'school district ceseatcb and _ 
evaluation units is explored', Tiie approach developed- argues that 
vl-^ation in eva^.uation unit directors' ro'xe conflict, and ambiguity 
4e"a fnnc+ion of both school district and evaluation unit 
chaJacter*'^ics: s°nce both sets of organizational features in«.uence 
Jieiocfai'cSntext-Mithin «hich the director J^g^^^"^^?^"^^^""' 
district variables (formalization* size, and heteEogeoeity).. and 
three evaluation unit. variables (history, . budget, .and f f ji^®) ^ 
weS usid. Results .showed school district variables f ^nif icantly 
related to ambiguity ]and conflict, while evaluation unit 
cor-elated with ambigui'ty but "not conflict. The argument .that the 
SociS resourc^charactekstics^ school district are key 

soSicL o? informal conflict and emblguity^confronted by 

A*i'lr^nT'i vAs not resolved. It was concluded, however, "Chat 
e;IlS?Ionuni?f. us? become .Involved' in classroom ^activities if they 
are to affect school district fUpctioning. (Authot/GK) 
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rairCONlilCT AND-AMBIGUITY AMONG SCHOOL DISTRICT EVALUATION UNIT HEAD?^ : ^ 

This.explbratory study "seeks to explain variation In conflict and am- • 
biguity among a pati^ of directors of school district research and . 

eValtBtion units . The approgich developed argues that variation in eval ua- 
tion unit directors' role conflict and ambiguity is. a function of both school 
.district ahd evaluation unit characteristics sinde {ioth sets of organizational 
!' featured influence, tie social context within^ Which the di r^ tor functions . 
^ Schodl district research and evaluation unit heads face complex admini- 
Itrative pnoblems. • Thejr. organizations are, typically, both new and small 
(Lyon", Doscher, McGUnahan, & Willians. .197^). The resources' they have ; 
available, impart because of their newness and size (which makes competi- 
: tion with other units difficult), are scarce. At the same time, the deminds 
placed upon tllem by powerful persons and .organizations in their school district 
and elsewhere are e,(tensive and growing.. Federal . state, county, and other 
school unites increasingly require information from school districts concern- 
ing the efWtiyeness of program functioning in specified areas. Moreover, - 
•since the field ofivaluation research has emerged recently, Vhe^background, 
■ and training of uhit directors^is frequently in other areas. Thi^mbina- 
' :tion-minimal U training, increasing service dem'and, and inadequate resources 
provide^all tij/ ingredients necessary for deep-seated role conflict and am- 
biguity. 

Increasingly, organizational 'theorists are recognizing the significance 
of enviro/men'tal fic^^ors on organizations. Perrow (1979) has referred to 
this emiasi; as a "new wave-gathering force." Theorists in the fields of 
contii^^ncifci resource dependence, ecology, political jeconomy, and open 



Systems (Hal i, 1977; Pfeffer & Salancik, 1978; Al^^ |579; _ 
Katz & Kahn,^966) all emphasize in one form or ^M Bfthe impact of the 
environment'on the focal organization. Thts f JmM |rticularly impor- 

"tant to the understanding of leader behavior iS|^H|f*®** bound|jry-span- 
nyng orgai»izatTo7is (Aldrich.S Herke*-, 1977) sutfr'^^^^ch and -evaluation 
units. . The research evidence suggests, that bbundary-^p^ers experience high 

.levels of role conflict (Organ, 1971 and 1-976; Organ #ireeri, 1972; Adams, 
1976; Miles, 1976). The evi"ience is less conclWiv^^fearding the relation-, 
ship between boundary- spaiining and role ambiguity, mvmost systematic 
study of aiTtiguity is that of March and 01 sen (1976). March and his col- 
leagues not only view ambiguity as closely linked to the choice process but,, 

• in addition, assert that it is endemic to pubTic and educational organiza- 
tions CCohen & March, 1976). In a recent review of role conflict researph 
Whetten 0978). observed that "... what is significant about the literature 
on boundary scanning is the. noticeable lack of interest in systematically 

exploring the sources of role conflict." With the exception of the March and 

- ■ 3 ' 

Olsen study, the .same could be said about research on role ambiguity. ^ 

' APPROACH AND HYPOTHESES 

Although role conflict and ambiguity are related (see Kahn.et ai-> 
1964), they ite not identical. Conflict comes from the quality and quantity 
o# demands placed on persons while ambiguity refers simply to perceived un^ ' 
certainty. The relationship between these variables is largely umexplored. 
• March and Olsen (1976) 'claim that "individuals l^ind themselves in a more 



complex, le^s sjtablev and less ijd^i^too^^ tjiat; described by 

standard-theorTevtif organic are piacey in' a world 

over which they often have only nwdest CO (p. 21). Wnbiguity in 

educational organi^ations^e^pecially-among leaders in thisUype of social 
system', is the name of the game. As for role^^'W^^ p^«Qeerver^ 
cal study of the phenomenon by 6rb|Sv;M^ and'McEachern (1958) was of 

school principals. Given the newness and instability of school evaluation 

■■ ■' :■ .. ■■■ ■ ^ ., . ■ ■ . . 

units both phenomena should be extant in bur sample. 

Contrary to^the standard portrait of .schools as unsuccessful organi- 
zationsy Meyer them as iiighly successful, because they have 

survived and even substantially expaj/ded their resource base. The basis • 
for their success is their con foVmfty to society's institutionalized rules 
and the fact that they have become "relatively decoupled frpm the technical 
work of instruction." ' Unlike business firms which carefully control their 
technical structures ]^ool s leave the actual instructional tasks rela-. 
tively unevaluated* and uncontrolled. Since evaluation units may be techr 
nically responsible both for student testing and for reviewing ijis.tructional 
programs, we might expect that evaluation unit director^ face far more^^ 
conflict and ambiguity than their counterparts in business firms. Their 
work is actually or potentially related to the schools' most fundamental 
tasks. 

•; bur approach emphasizes the preeminent affect of context or structure 
on the organizational subunit and thence on role conflict ?fid ambiguityj 

\ Three school district variables influence the context within which evaluation 
unns^;foffction: formalization, size, and heterogeneity. Each of the vari- 
ables affect^Yextent of interest group pressures likely to be experienced* 

V by the un^il director^ ^ \ .. : , 



I . - - - ■ . ■ 

"Formalization" refers to rules; its opposite is anomie. The more 
regulated the distnct organization the greater the ur\it's administrative - 
control over uncertainty. The more formalized the organization., the more 
protected the unit head' feels (Gouldner, 1954; Miles & Perreault, 1976) . 
- and the le^ likely he/she experiences role conflict. Both district size and 
heterogeneity influence diversity of interest groups in the district. • 
Kahn et aV {1964) note that persons ig positions that link units . 

if/-; ■ . . ' , ■ ' ■ ■ . 

are more likely to'be subjected to conflicting requirements and pressures -. , 
because they interact with persons, who have competing goals and standards. 

■ ■ ■ % 

!jJ6wever, formalization should relieve some of this conflict insofar as 
rules closely specify task and goal responsibilities. Size and hetero- ' 
geneity affect a district's political capabilities and its ability to. 
capture resources from the society. While, on one hand, large size and 
heterogeneity demand respect and hence enable districts to comnand greater ' 
amounts of resources, on the other hand, they imply.more competing- interest 
groups; the greater the diversity of interest groups in a school district, 
the more Wkely there will be conflict among them. Hypothetically, inter- 
,est group conflict in thfe school district should lead to role conflict 
and ambiguity among evaluation unit heads. ^ 

The unit variables. of concern are history and resource availability. 
'. The former was measured here by length of time the unit has %isted. 
Pfeffer (1979) suggests that survival is the ultimate test of organiza- 
tional effectiveness and history is inextricably linked to that concept. 
The latter variable was here measured specifically iy budget and number 
of staff personnel . History and unit resources are substantially deter- 
. . mined by decisions external to the focal unit. .J>feffer also proposed that 
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persons have less effect on organizations than the institutional context, 
because selection processes ensure iiomogeneity among leaders. . Leaders 
are seen as.having'little discretion, anyway; the major impact on outcomes- 
stems from resource ayaila^ity and,, in school districts in particular, 
this is generally outside the unit head's conYol ( Lei herson and O'Connor, - 
1972). Sin^ a unit (fi>ectpr'^s uncertairrty mainly revol.yes around resources 
we might have anticipated.that. unit variables would have a greater impact 
on ambiguity than on conflict. • • . 

Conflict 

"Roles" are generally defined as sets of expectations about behavior 
associated with organizational positions. Role conflict takes place when 
•the.bcctipant of a position, encounters inconsistent |iemands and expectations. 
Four t;rpes of role conflict hav^ been identified by Rizzo, House;, and 

Lirtzman tl970): ' 7 

■ "1. Conflict between the focal person's internal standards 

or values and the defined role behavior... 2. Conflict , 
■ between the tfme, resources, or capabilities of the fqcal - 

person and defined rol^ehavior... 3. Conflict between . 

several roles for the same person which require different 
- incompatible behaviors... 4; Conflicting- expectations and 
^ organizational demands in the form of incompatible policie?, 

conflicting r^que'sts from others, and incompatible standards 

of evaluation." . . * 

Riz^a; House, arfd Lirtzman developed the factorial ly identi fiable and 
indgpendent measures,' of role (fonflict and ambiguity that we adapted for 
. use in the present project.. Six items with the highest factor loadings 
. were selected from their larger set. The items, listed with perceot 
/aiSl^reement in our sample, were as follows: 



•■■ ■ : • • % Agree or 

■ .Items \ : Strongly Agree 

-^I recei/e assignments without the jnan power to . " 
. complete them.V , 65 

I work under incompatible policies and 91 ' 

guidelines. 

. I have to buck a rule or policy "in order to _ 

carry dut "an assignment. - / 20 ^ - 

I. receive assignments Without adequate resources 

and materi-als to execute them. . 

I have to do things that should be done 
differently.^ ' • , 

Ureceive incompatible -requests from two or more 

people. ^ ■ . 

It Should be noted that^ over fifty percent of the respondents selected 
the high role conflict response in three of trfe six-items. Two of these 
three were concerned With inadequate resources. 

Ambiguity 

' "Role ambiguity" refers to the situation that takes place when the 
occupant of a pos i ti on • Tacks the appropri ate rol e-rel ated inf orma ti on . *Th i s 
occurs when the position is not clearly defined or when access-to needed 
infonnati^n is impeded (for example, because of the occupant '.s inexperience 
or ^ecause' of the newness of the poisition in the organization).. Specifi- 
cally then, ambiguity refers to the degree of -felt certainty regarding ,: 
one's duties, authority, allocation of time, and goals. To measure ambir | 
; gultythe five items with the highest factor loadings were selected from 
I the;^ Rizz^/House, and Lirtzman set. the items listed with percent aig^emept 
in our samfJ'le were, as follows: ^ 1 



■ . ; . ' « Disagree or 

• Items Strongly Disagree 



feel certain about 'how much^uthority I have. . ; 

I haye clear, planned goals^ and ,objecti veis for " 
ny job. .1 

I knbw that I have divided my time properly. 
I know what, my responsibilities are. . 
I know exactly what is expected of me. 



12: ^. J 
30 



20 



IfisTpparent from- the above that role ambiguity was less conino|fi among 
directors than was conflict. The large proportion of the sample reported 
little ambiguity. Although we lacked comparative data, these findings would 
seem to contradict March and Olsen's claim regarding the pervasiveness^of 
^iguity. eons i stent with Rizza, House, and Lirtzman, we found a signifi- 
cant negative correlation between role conflict and ambiguity. (r=-.19, 
p<.001. See Table I . )• It may be that conflict produces expectatidnal 
clariiy. That isr^he harder one must work and the more corners inust be cut 
to get the work done, the less uncertain one is (or has time to be) about 

one's job. ' 

The respondents were selected through a two-stage process. First, 
letters were sent to all 750 school superintendents in districts with 
10,000 or more students and/'ttr a 501 sample of the 573 school districts 
with 5,000-9,999 students." All of the larger districts' and 81% of the . 
smaller ones responded indicating whether or not their district had an 
evaluation unit. Next, in spring, 1978 » a questionnaire was sent to all 
336 large school districts (10,000 or more Students) and to the 74 smaller 
ones identified as having evaluation units. A total of 2.63 unit heads 
(or 64.1%) returned thfi schedule. v 
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The evaluation unit heads were, typically, highly experienced and 
prof essiorval4y-trai ned . i ndi vi<lua-l s,- -Si xty--fi-ve- percent^ hel d_ the _docWrate^. 



most usually in administrSition, elementfiry or secondary education, statis-- 

tic3, or educational or'general psychology. Almost three out of ten had 

been school principals and over half ^were once elementary' or secondary 

school teachers. Very few (14.4%) had had any formal course work in 

evaluation. No .significant reUtionshJp- was found betweefj taking such 

courses' and role conflict or ambiguity. , 
•*', . . ' 

One important function of school district evaluation and research 

■ '•/ .'' 

units is to provide information of value to school administrators. Most 
of these units report directly to the^ superintendent gr through one inter- 
mediaT7. The job involves monitoring school programs indi recti yv^nd^m- 

phasizes testing student achievement. 

■ . ■ . ■ _ . ^ ■ ■ ■ ■ ; . . 

School District Variables . - . ' 

Three^ variables werp used: formalization, size, and heterdgeneity. 
Hage and Aiken (1970) and Hall (1977) define formalization as the rules and 
procedures organizations establish to handle contingencies. All unit 
hea^ were asked. to report the extent" to^hich there were written school 
board policies in six. areas: student conduct in classrooms, introduction 
of instructional ■innovations, type of curricular material to be used," 
student conduct on school grounds, instructional methods teachers use, 
and criteria used irneValuating student learning. . This was consisteht' 
with Pugh et al.'s (1968) definition of formalization as "the extent to 
which rules, procedures, instructions, and communications are written." 
A factor analysis of the scale resulted, in one factor (unnamed) that 
explained 39 percent of the variance of the items. Average item-item 



correlation was .26. Cronbach's (1951) Alpha was .68. indicating repli- 

— — — — ■ 4 ' . ■ ■ - . 

^biTfty and reliability. 

School distHcts were dassified by s'ize into four groups:^ metropoli- 
tan districts (enrollTOnt. 45^000 or more); large districts (enrollment,- 
.25.000-44.99?); mediun districts (enrollment. 10.000-24.999); and small 
•districts (enrollment. 5.000-9.999). Exfstence of an evaluation yft^^^ 
positively related to size. (Districts under\5.o6o students were ?xcldded 

from the study.) . 

"Heterogeneity" referred mainly to the ethnic-racial student mix in 

the distHct.' The measure selected was percent of students eligible for 
the nationwide free-lunch program.- As Table 1 shows, this jneasure corre- 
lated significantly with percent White, percent Black, percent Hispanic, 
and percent students scoring in the bottom quartile. - 

^ TABLE 1 

Correlations Among Indicators of District Heterogeneity ' , 





Percent 
Black 


Percent 
Hispanic 


' i ' ■ — — ■ 

Bottom Quartile ^ 
Students 


Percent 
Free Lunch 


Percent White 


-.77** 


-.47** 

* 


-.63** . 


-'76** 


Percent Black 




-.12** 


.56** ' 


.69** 


Percent His plan ic 






.27** 


.25**' 


.ffottom Quartile 
Students 

1. — 








.66** 



* p < .05 
** p < .001 

Tests of significance are two-tailed. 



. Blau ;(1977)N,iefines heterogeneity "th^ ''ls't/'**^bu'*^^o'^ ^^' a population 
among groups -in tirms of a nominal parameter" If^h 3) ^ lists thirteen 
nominal parameter^: •°sex, race, religion, et^^' /tNi^i^tion, cUn, occupa- 
tioh, place' of wcirk, place of residency. ind\i^i\\f^fi status, political 
affiUati on, national origin, and langtlaige. 4/\i«/^ite=^r the number of, groups 
4nd the inore evenly a population is.diyided ^A'^U^" ««' the greateii^ the 
■ Seterogenei.ty.:- T^^^ Proigrara is bai^Ajtur-^ill if^gness to participate 

Using this measure as a heterogeneity index ^jnaiximized the ethnic- 

racial mix as: well as, the mix/on marjtal statiA^*,^^^ ^^Qraal oKgin, and 



\ 



language.^ On the other tiarvd, it may welf be jl^Vi^tecJ wil^ 
geneity. Unfortunately, data ^w^s jiaavai labl? ^ [j^^r^ the associati ofi 
Of -the index with each Of these variables. ; \ 

Evaluation Unit Variables ^ - .■ - 

' "Hikory'' Werred to the length of tin^^^ tll^ynrv^'^t was i\ existence. - - 

As , antici Plated, most were new organizations, / ,\;^ne'^^''''^ ^ 
five years oVd or .less while 62% were ten ye^^ jf^ge or under- Only about 
one-seventh of the units (1456) had been in e^^/^f^fWh y^ars or. 

longer.'' '• ■ ■ * ' 

/Two indexes of resources were used. - MotiMry; * ):e5^^^ 
% the unit's percentage of the.school distiijA<)^V/*^^aHy^budget.. In gen- 
eral , the larger; the unit's percent of the bMt ^*<li^ feate^f the amount 
of slack resources /def tned by C^r^rt & Marc^^^lj^' t^^*tjffference be- 
tween existing resources and acj^vated dema^t^l; ^'•V^oh fr 
detennined by the number of full^ staffi^ ^ t|i un« ' In i3 units only 
part-time staff were employed; in 108 •there /^^^^^^^^^ 



and 81 unitk ranged in size from 2-5 fuHstime peysons. The largs&t unit 

reported 90 staff members. It may. b^" asSjj^d that the^ larger the staff 

the greater the personnel resources ^^d '"^'^^ ^lack. . - , ' 

■ • ■ * 

In Table 2 the means, standard ^levi^tions, N's, and intercorrelations ^ 
are presented for the principal v^^^^bl^s gsed in the study. The findings 
show that the three district vari^bVs '^^re significantly- related both to 
ambiguity and conflict, while the ."'^U ^M^bles corVelated with ambiguity 

but not conflict, 

Evaluation unit variables were hi5tQy.y, .lj>udget, and staff sjze. A 

-slight negative correlation wa§ fbun^ between history and ambiguity. The 
longer the unit was in existence, th^^. ie^s atjbiguity was experienced by 
the dtrector.' A modest re.lations^'^''i Ws,fi?"^d\*»etween the two resource 
Indexes and ambiguity. Budget and Haf"^ ^^^^ab^^^ty, which not surpri- 
sl^y were positively correlated with %e another., generate increased 
demands on the , director. In l^e^y^cJ^ \nd^)5e^' s {l97S) terns , slack provides 
solutions for :problems and suffjcji^>^t P^Hi<^"^P^nts,for each and every 
choice. The greater the unit's $ia^k ^so^^^ces, the more problems for 
the director and hence the greater his/her Uncertainty as to how to resolve ^ 

■them. ■■" ■ ■ 

No significant relationship^ w^^e toU^<^ between the three unit vari- 
aliles arvd. role conflict.' Two oppos^^n^ hypotheses were possible; that 
new units would produce more ro]e %n^''lc*^han >old ones in that the formerj^ 

. being less institutional Tzed, WD««^^ be.le^s able to reconcile incojnpatibTe 



TABLE 2 . ' '^^ 

Means, Standard Deviations, N's, and Correlations of Dependent and Mpendent Variables 



Variable 


W 

i Mean 


u — ' 

btanaara 

Deviation Ambiguity 


History Budget 


EU 

Staff 


District 
Size 


District District 
Formalization Heterogeneity 


Conflict . 


263 2.23 


.69 -.19*** 


-.004 -,03 ■ 


.07 


.16*** 


-.08* 


.12** 


•Ambiguity. 


i63 2.96 


.47 - 


-.07*'. vl9*** 


'.16** 


.03 


.10** 


■ .13** 


.History 


249 68.33 


io;36 


,16** 

■ v 


-.10** 


-.16** 


-.01 


-.08* 


tU Budget 


•223 33. Bo 


*ft.00 




.31*** 


.007 


-.04 


.06 


' ^^tJ Staff 

\ 

fiistrict 


262 4.77 


9.94 - 




m ■ 


44*** 


-.03 


.25*** 


263 2.51 


.99 








. .002 


.33*** 


^Jstrict 
Epmialization 


263 1.95 


.42 






\ 

■ fi 


■ ■ 


.,16** 


■District; 
.Heterogeneity 


225 24.74 


19.79 






I • 


mm' 




^ "U- ' V 

i ;*p.< ' 


* 








/ 


■ 1 




** p < .05 




I- , ■ ' ' 













***p< .001 : 

Tests of significance-are 2-tailed 
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demands .and pressures; or. alternatively, that old units would exj^erience 
greater role coriflict since they had^had more time to become known, would 
thereby generate more demands from externaV units, and hence, experience 
greater pressures than new units. However, neither history nor slack 
engendered inconsistent demands and expectation* for the director. It 

/ • might have, been anticipated' Sat slack would indrease the director's. 
I role conflict since demands increase when more resources are available, 
that, insofar as these demands outrun resources.! conflict results. This 

■ model suggests that the relationship between slack and conflict is curvi- 
linear. . \ 

/ The bivariate relationships between school district characteristics 

and the dependent variables were.: with one exception, statistically signi- 
•ficant. District size was related to role conflict but- hot to ambiguity. -/ 
Kahn et aV (1964) also found a significant correlation between size and 
' role conflict. Size has been related to structural elaboration (Meirer; 
1972) and to subgoal development (Dearborn and Siitlon. 1958). both/Indexes^ 
of differentiation. ^Differentiation creates a lack of consensus whi^H 
generates role conflict ^r the administrator. } 

Formalization bore'a negative relationship to'rple^onflict which may 
mean. that rules act as intended in regulating.expectaiions and enhancing 
consensus. However,: fonialization bore a positiv/ relationship to ambi- 
guity. That is. the more rules.. the^greaterWdirector's uncertainty- 
obvious ly not the inten^d function of ruWs/ It may be that large nunbers 
■ of rules and policies are so cumbersome an^ complex that they induce uncer- 
tainty among heads of units. 
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Heterogeneity was the final context variable. Not surpHsingly. it 
was significantly correlated- with district size. This was reassuring" since 
large metropolitan distri<5ts should be the ni,35^ divecse and small ones least 
diverse. Heterogeneity waj positively related to role\conflict. This find- 
ing supports Thompson's (1960). theory which asserted that heterogeneity of 
organization member^ generates role diversity which, in tuni.i causes organ- 
izational conflict/ Organizations with heterogeneous populatiorrs develop 
numerous "latent roles" which present complex management' probl 6ms,' The 
same, finding would De predicted by political economy and resource depen- 
dence theory (Pfeffer & Salancik. 1978;. and Zald. 1969): the greater the 
heterogeneity of the district, the more diverse and lexWnsive are competing 
groups. The more there are of such group^s. all seeking to assert their : 
'interests, the more conflict experienced by the unit head.; His/her task 
is complicated under such circumstances as he/she seeks ^t(i reconcile demands 
for infomition from teachers, community groups, parew^rqgr^^d^^^ 
the schobi board, principals, administrkors'. and. in the case of desegre- 
gation, the courts. Heterogeneity was also" positively correlated with 
; ambiguity. One explanation iWthat heterogeneity leads to increased needs 
¥or information input and for di'stributioti of.output. The greater the 
iunber of such demands the less certain" the director I's regarding dutiesi 
aiithority. time allocHion, and.obj|ptives. Hence. th6 greater the felt 



anrf)iguity. ^ ' ' - 

The regression analyses 'were designed to 'tell us tiow much of the 
variance in conflict ^nd ambiguity the complete set of independent vari- 
ables explained. The regression equation used'^ took the following basic ; 

form: 



Conflict » a -f' b, (School District Variables) + (Unit Variables) + Ambi- 
guity Error. ; • • 

The independent variables were regressed in stepwise fashion; first, 
on conflict and then on adbiguity. The district variables Were entered 
first since^ presumably they were. less controllable by the directors than 
jepe^he unit variables. Tables 3 and 4 present the main findings . The 
multiple R for the "equations ranged from .18 to -.35 indicating that the . 
"independent va-riables accounted for only about 3% to 12% tff the variance 
in conflict and ambi guilly/ Obviously, this was not a great .deal. The ' 
more conservative adjusted measures which consider the number of vari- 
ables in 'the equation, reduced this amount further. 

' t' . , TABLE 3 

' kegression of School Dfstrict and Evaluation Unit 

' Variables, on Role Ambiguity 



Independent 
Variable 


Uhsfandardized 
Rejgression 
Coefficient 


Standard 
Error 


Stj(ndardized 
^/^egression 
/Coefficient 


Heterogeneity 


. -306 : ^ 


.001 


/ .132 


Size • 


-.233 


.038 / 


-.051 ' 


Formalization 


. 158^ 


'.078 


.144 


Histor7 


-.308 


/.og3 


-;065 


EU Budget 


.155:?. 


]/; r .0008 


.146 


'EU Staff . ' " 


'"■'.■.454.: v:: 


. .003 ' 


^ '-: , ''.105 


Conflict 


■ .■■.- -.128/ ■■■ 


.048 

• 


. ' -.192 


CConstant) 








Multiple R . 


•; '\. .350. 






R Square 


.122 




A • • • • • 


.Adjusted R Squ^e 


, ' .088 







J 



TABLE 4 V 



Regression \qf School District and Evaluati 



on Unit 



Variables on Role , Conflict 



Independent 
Variable^ 



Unstandardized 
Regression 
Coeff;icient 



' Standard 
-Error 



Standardized' 
Regression 
Coefficient 



Heterogeneity 
Size . 
..Formalization 
History* 
EU Budget , 
EU Staff ' 
Ambiguity 
(Constant) 

Multip.le'R 
R Square 

Adjusted R Square 



.366 
.138 
-.148 
. .143 
.161 
.948 
-.293 
2.888 

.337 
.113 
.078 



.002 



.057 
.120 
.005 , 
.081^ 
.005*". 
. lli 



..105 
.200 

-.090 

. .020 ; 
,.0001 
..€14 

-.194 
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To suraiarize th4s section and the results thus far, we anticipated' 
that a selected set of school district variables and evaluation unit var-. . 
iables would explain role confliclxand alllblgulty among" uhlt dlr^gtors. ^ In^' 
fact, we were able to explain only a small portion of the variance. We 
turned , nexjt, to the probl em of organl.zati onal i nf Tuerfcel on the use _ of 
eval uation -Information. The mairi ques.t^on we sought to answer in this _ 
section was: Is, there a relationship between the reported users of *valu- 
atlon data and role conflict and ambiguity among °uh1t heads?. - ^ 



Conflict, Ambiguity, afid Use of Evaluation Data. . , 

Lyon, poscher, and McGranahari (1978) providfe extensive information 
on what evaluation unit heads do. They found that 95% of the urtit^l rectors 



ranked student achievemenlTas^ of their most tim^-consuming activities. 
ISeventy-four percent ranked it as the njost time-consuming. Seventy-five . 
percent of the directors claimed that testing was the major data collection ■ 
method. Moreover, most unit heads reported that almost half their time, 
46%, was spent on early ^childhood and elementary education. The authors 
of the report conclu(SedJ;h'at "... the survey and fieldwork confirm the - 
continuing dominance of testing in all activities of evaluation offices .. . " 

(1978> p. 100). ■ ^ ^ 

. David's (1978) inten^ve fieldjtudy of school distriict use of Title I 
evaluations found that they ".'.. do not primarily serve either as a means 
of judging the program or as a guide to,program improvement." (P- V)- This 
was so for three reasons?. (1) Most programs were stable. Only minor 
changes. took place anyway; (2) Typically, evaluation results' were received 
.t,pp'la,te to be useful; and (3) other factars, such as political demands, 
flayed a key^le ill program change. If these 'findings hold up when repli- 
cated , then- wd must assume, that these units mainly meet reporting require- 
ments and do'not pl^ay a significant part in program change. This may be 
because there isn't a great deal of program c^iange^ther than that which 
comes about as a result of externally-imposed legislation. 
* - ^ Respondents were asked to identify the major users of their, units ' 
. reports. It was found that the consistent users: were program" directors • 

(62%), superintendents (eOJf'), central office staff (58%), and principals;. 

(52%). Only one-third t^ported^eachers as consistent users. This Vas 
>bout the same percentage reporting federal and state agencies as u'Sers. ^ 

It was evident that the units service mainly the school administration. 
As Table 5 demonstrates, role conflict was negatively correlated with 

service use by superintendents and principals; that is, tho?e who did not 



report ttiese parties as consistenTlisers were most' likely t^o experience 
high confTict. This^^stt^ests that the closer the service ties between the 
evaluation unit head and the school superintendent and principals, the 
less conflict was experienced. In other words, the way unit heads reduced 
stress was by acconmodating to those who held line authority over them. 



* . TABLE 5 



District Use of Evaluation Unit Data and 
Role Conflict and Ainbiguity 



Reported Consistent User Role Conflict Role Ambjguity 



Superintendent 



-.20 (p=.02) .19 (p=.02j 



Principals ^ -.18 (p=.03) .12(p=.10) 

Board members, , ^ — - -19 (P=-001) 

Parents or local citizen groups * — 

•Teachers ' , -21 (p=.007) 

Central office staff - — — " -.15 (p=.04) 

Federal agencies ' ' — • ,10 (p=.0p3) 

State agencies < " r— — ~r 

Program Director ■ ' ', — 5,— .13 (P=-fl^) 

* A different pattern was found for. ambiguity. Unit heads .with high" 
ambiguity were more likely to report supeHntentfents, principals, "program 
directors, board members, and federal'agencies as consistent- users of their 
services and less likely to report, teachers and central office personnel 
as users. It appears that the greater the range of perceived use of evalu- 
'"^tion services, the more the felt ambiguity. Any -type of admitirstrative 
cohta-ct can generate uncertainty, but contact with those highly placed in. 
the organization (such as superintendents ^ principals, board members) was 



associated With high ambiguity while contact with lower level roles 
(teachers, program directors) was associated with low anibituity. 

Ambiguity occurs .when shared role specifications are incomplete—the 
officeholder is unsure what is desired or how to behave. Unit direct^*, 
felt most uncertain when 'consistent users were •principals, superintendents, 
board members, program directors, and Inderal agencies. Perhaps this was 
because these officials not only have organizational clout, but also have 
little confidence in the test data tffe evaluation units produce. Thefr 
profound lack of confidence in the units' major product was described and 
analyzed by David (1978) who Quoted several official s'^^tel Ting criticisms 
of standardized test jresults: 

■ , . . 

V "How ca'n you evaluate when kids are starting at different . . ^ 
places and developing at different rates? ^ Meansr don't ■ 
mean anything." • • - (Director) 

"IndividMal diagnostic tools provide the bWs for my . 
•♦ judqment of program success;' not the standardized tests. 

.;. , • ^ (Principal). , . 

I . ■ ■ ■ . " " ■ > \ . . 

"If the standardized test scores 'are negative, it's okay 

because everyone buysvthe argument thafthey can 1)e , 
discredited." ■ ^ , (Administrator) 

■ ' ■ . . ' ■• ' ■■ ■ ■ ■" ■ -. - . 

David (1978) (Vlso reported that teachers were critical of testing. 
However, unit heads' ambiguiiy was low when teachers were consistent users, 
probably because they were 'less threatened by teacher criticisms. The Tow 
regard of. their superiors understandably carried p)re weight. 



CONCLUSIONS" 

Juvenal wrote in hi s Satires , ''But who i s to guard the guardi ans 
themselves?" while Plato, tnuch less the realist, stated in the Republic, 




"What an absurd idea— a guardian to need a guardian." Evaluation is a 
booming enterprise and evaluation units in school districts are to be 
found in many districts of substantial size. These units are cbnceived 
by.some to be public guardjans,. data collectors, and assessors. This 
paper argues that thfe social resource characteristics of the school 
district-that is, the* external context within which evaluation units 
function, and the organization of the unit itself--are key sources of 
information about them and particularly about the amount of conflict and 
^ambiguity confronted by the directors. Contrary to expectations, |choal 
district and eva.luation unit variables did not explain much of the variance 
in the directors' role conflict and ambiguity. However, oui* findings do 
suggest that. evaluation unit heads fill a very difficult position in the 
school district and that ^ key source -of thai r difficulties is thataheir 
main output is not^ighly regarded by their superiors. .Still/another 
problem stems from the fact that they have- limited contact with' the pro-' , 
grams they, evaluate. These two problems are Wated because if they had 
better'contact with major school programs the/would have access to infor- 
mation which could enhance their orgaLnizational position and power and . 
improve the quality of 'their contribution. The directors' overall level 
of role cdnfiict was' high while their level of role ambiguity was low. 
Since power and ambiguity are highly correlated, this latter finding re- 
flects their low power. It may be that the tasks pf the directors are 
too well established and^not ;ambiguou$ enough. If evaluation units are . 
to make a difference in school district innovation and functioning, they 
must involve themselves closely in classropm activities and related 



programs. Although this would {jroduce greater uncertaio.$y for the direc- 
tors it could also help make their eval.uation tasks considerably more 
meaningful . ^ * 
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FOOTNOTES 



1. Data Collection for this study was undertaken by the Center for the > 
Study of Evaluation, UCLA under the direction of Dr. Catherine Lyon. I --^ 
am grateful for her assistance, and for the support, financial and other- 
wise, of the center's staff, part^pularly D-^-Eva Baker and Dr Adn 
Bank. This project was also partially supported by NIMH (MN-14583) i 
am most appreciative of the research assistance of Pamela Tolbert and the- 
typing of Andrea Anzalone. John Meyer and Mary Ann Mill sap provided many 
helpfUr comments on the manuscript. . 

A few comnents on 'the kistory of the project will serve as useful 
background. In Spring, 1977 a -group of UCUA faculty agreed af^js^an 
advisory panel for the Center for the ^tudy of 'Evaluation's (CSE) project 

;on the role of evaluation in public school districts, directed by 
Dr. Catherine Lyon (Lyon, Doschfer, McGranahan, Williams, 1978). The ^ 
functions of tJpTs group were two-fold: first, to adv.ise t^^e ^irectbr jre- 
garding her national questionnaire suryey of school districts and a set 
of planned^ase studies of school district evaluation units; and secojd, . 
to develop papers "fhat would focus on issues r^'levant to the research . _ - 
project." (Conmittee members were O'Shea, Chair, and. Wil iams, Schpol of 
Education-.'O'fteilly, Management; Grusky and Zucker. SodTology. _This became 
the core group although some other members served for brief pei^ijasvot 
tirte. The quotation is from the letter of invitation to the author by ^ 
the Conmittee Chair.) The early sessions were devoted to broad disqus^ions 
of research strategy and to specific items that might be included in the 
questionnaire, -ifhe bulk of the responsibility and day-to-day work involved 

. ?n 5es?gniil5! administering, and preparing the^data from the q^stionnaire 
was performed under the supervision of -the Project Director. The contri- 
butions of the advisory panel were primarily supplementary and supportive. 
The plan of the research program was to conduct two types of investigation. 
The main source of systematic data was to be a national survey of school 
district evaluation unit heads. The survey was to be supplemented by a . 
small number of field studies of selected school systems-sk_ ^he^stud)^ re-^ 
ported here is based only upon the national survey data since field-study 
data were unavailable. The .questionnaire data themselves, of cfturse, _ 
present several problems. We do not know who actually filled. out the qyes- 
tionnaires. Although the head oF each evaluation unit was requested 
do so, someone else may in. some cases have completed the ^^orms. .A seqond ^ 
issue concerns the veracity of the responses. We have no way ^ofki^wng 
how each- respondent perceived the questions, how carefully he/she replied, 
or how factually-based were the answers. 

■ 2. For example, Stuffleb^am, e t al . (1971) write: ^^'As a. response to ^ 
outside prfessures, many schdol districts have installed or are now install- 
ing evaluation units" (p. 268, underlines added). 
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' March ind flls^n (1976) refer to 1^ofiir:types of^a^ 

duitv^of attCT^ understanding, ambiguity of. history, 

begiii to do justice to the richness of this typology- 

4; The correlation ^^ra 
ij ^author upon request. . 
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